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The blurring of photographs by image motion during exposure is 
studied by means of a simple model. Conditions under which it is possible 
to recover the unblurred image are determined and some methods of res- 
toration are described. 

I. INTRODUCTION AND SUMMARY 

This paper is concerned with the feasibility of restoring photographs 
that have been blurred during exposure by relative motion between the 
camera and the entire scene being photographed.* It is assumed that all 
objects of the scene are at rest relative to each other. Several simple 
mathematical models of this situation are investigated. 

Section II treats the case of uniform translation between film and 
image. During exposure an area, A, of the image crosses over the margins 
onto the film. It is shown that unique restoration of the scene from 
the blurred photograph is, in general, impossible without a priori 
knowledge of certain portions of the undistorted image of area A. 
An algorithm is given for the restoration when this a priori knowledge 
is available, and a filtering technique is described that covers a case 
of frequent interest, — the photographing of a small object viewed 
against a uniform background. 

The restoration techniques require knowledge of the translation 
undergone. Section III describes a method of estimating this displace- 
ment from the blurred photograph. 

In Section IV more general image motions are considered. The case 
of pure rotation has many features in common with that of pure transla- 
tion. Estimation of the parameters of the motion, however, appears 
to be more difficult in this case. 



* This work was carried out at the Woods Hole 1966 Summer Study on Restora- 
tion of Atmospherically degraded Images held by the National Academy of Sciences. 

2353 



2354 THE BELL SYSTEM TECHNICAL JOURNAL, DECEMBER 1967 

II. IMAGE TRANSLATION 

We are concerned here with photographs blurred because of a uniform 
relative motion during exposure between the camera and the object 
being photographed. For mathematical simplicity, in this section we 
treat the problem as one-dimensional; the modifications necessary to 
describe the more accurate two-dimensional model are evident. 

Let g(x) denote the illuminance from a scene or object being photo- 
graphed that would result along a line in the image plane of the camera 
if there were no relative motion between the camera and the object. 
We suppose g(x) defined for all values of x. The film occupies the interval 
| x | ^ L. Imagine now that during the exposure time T the image 
moves with constant velocity v along the image plane in the rc-direction. 
The total light energy e(x) incident on a point x in this plane is 

e(.r) = c, ( g(x - vt) dt 

Jo (1) 



= c 2 / g(y) dy, 

J x-a 



where a = vT. In appropriate units, the density of the photograph is 
then 

f(x) = r[e(.r)], | x J £ L, (2) 

where r(e) is the response curve of the film. Our aim is to recover g, 
or a portion of g, from a knowledge of j(x), \x\ ^ L. If we assume 
the film response is monotone and known, knowledge of j(x) is equiv- 
alent by (2) to knowledge of e(x) = r _I [/(*)], I x \ g L. For our pur- 
poses, then, it suffices to assume e(x) known, or equivalently, to assume 
that the film response is linear. Accordingly, we henceforth consider 
recovering the undistorted scene g(x) from the blurred photograph 

Kx) = f gin) dy, \x\$L, (3) 

J x — a 

where it is assumed that a is known. (The problem of estimating a 
is treated in Section III.) 
From (3) we obtain at once 

f(x) = g(x) - g(x - a) 

or 

g(x) = f(x) + g(x - a), \x\*L, (4) 
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the basic recovery equation. If g(x) were known for — L — a ^ x ^ —L, 
say 

g(x) = <p(x), -L - a ^ x ^ -L, (5) 

then g could be determined at once from (4) across the entire film 
interval. One has 

g(x) = f(x) + V (x - a) _ L ^ xS _ L + a 

g(x) = /'(.r) + g(x - a) 

= /'(.r) +/'(*- a) +<p{x-2a), 

-L + a ^ x ^ -L + 2a 



1-0 



9(x) = Z f(x - ja) + <p(x - ka), (6) 



-L + (k - l)a ^ x ^ -L + fca 
fc = 1, 2, ••• , K 
g(x) = it f'(x - ja) + <p[x -(K+ l)o], 

-L + Ka ^ a; ^ L, 

where K = [2L/a] is the largest integer not greater than 2L/a. Similarly, 
if g(x) is known on any interval H of length a contained in the interval 
/ = (-L — a, L), (4) can be used to determine g first in the intervals 
of length a adjacent to H and then successively to determine o through- 
out /. More generally, if g is known on a set S of intervals in / whose 
translates by various multiples of a form a set containing an interval 
of length a in /, then g can be determined everywhere in / by repeated 
application of (4). We call such a set S an admissible a priori set. 

Two quite different cases of restoration are now evident: (i) g known 
beforehand on an admissible a priori set; (it) g not so known. In the 
former case, exact restoration is possible in principle. In the latter 
case, unique restoration is not possible. Indeed, a given blurred photo- 
graph / could arise from infinitely many different scenes. For example, 
if no a priori knowledge of g is available, choose g{x) — <p(x) for — L — 
a ^ x < —L with <p arbitrary. Use (6) then to determine g for — L ^ 
x ^ L. This scene g will give rise to a blurred photograph differing 
from / by at most a constant. (By judicious choice of background, 
and by moving the camera, it is possible to make the devil appear 
as only a slightly-blurred saint!) Similar considerations show that if 
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g is not known beforehand on some admissible a priori set, its values 
can be assigned arbitrarily on some set of points in / and determined 
elsewhere to give a scene that could produce a given blurred photograph. 
There seems to be little useful that can be said, in general, about 
restoration of blurred photographs when g is not known on some 
admissible a priori set. 

A case of importance in practice where something of value can be 
said concerns the restoration of a photograph of a small object moving 
across a uniform background. We suppose the background corresponds 
to photographic density zero and that the blurred object image is 
smaller than the photograph. Specifically, assume that it is known 
a priori that the unblurred object image g{x) would be nonzero only 
in the interval x ^ x ^ x + (p - IK where x ^ —L, x + pa ^ L. 
The blurred photograph then would have a density different from 
zero only for -L ^ x ^ x ^ x + pa g L. We define / everywhere 
by taking 

j(x) = 0, x < x , x > .To + pa. (7) 

We define g = for x < x and x > x + (p - l)a. In this case, the 
solution of form (6) becomes simply 

g&) = E /'(* - i«). * ^ x ° + P a < 8) 

g(fi) = Z f(p ~ &> x » + pa < x ^ x + (p + Da 

v x i 



o(x) = Z /'(' }: - i«). x » + (p + n _ ] ) a < * = x ° + vP + n ) a 

?i = 1,2, ••• . (9) 

Because of our assumptions, the sums in (9) must give zero for n = 1, 
2, • • • and x in the indicated ranges. They are in this sense nugatory. 
Equation (8) gives g = for x < x because of (7). In the range of 
interest x ^ x ^ x + pa, it gives a simple algorithm for obtaining 
a true picture of the object. 

Equation (8) can be instrumented in many ways. The derivative f 
of the blurred photo extended by (7) can be obtained as a transparency 
by optical filtering techniques. The sum (8) then can be found by p- 
tuple exposure of a film with the image of f being translated by an 
amount a by a mirror between each exposure. 
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An alternate restoration method suggested by (8) sheds some light 
on a filtering technique previously reported in the literature. 1 Let us 
define for all x 

0(x) - E }'(x - ja) (10) 

1=0 

with / defined everywhere by (7). 

For x ^ x Q + pa, § will coincide with g, but for x > x + V a it gives 
values different from g. From the Fourier representation 

f(x) = JT e ^ F (X) d\ 
if follows that 

/CO 
e ,x 'tXF(X)e _, '' Xa tfX 

so that (10) can be written 

0(x) = r dhe iXx i\F(\) £e- ,Xfl 

•'-co j=0 

= r ^ e f ^(x) sb ^i® ie-«>-»«°™ 

J _oo sin (Xo/2) 

which shows that $[a; + (p — l)(a/2)] can be obtained from the extended 
blurred photograph / by processing with a filter having transfer function 

_ i\ sin (Xpg/2) . u 

1(X) ~ sin(Xa/2) ' (11) 

A different filter for restoration in the present case can be derived 
as follows. Recall our assumption that 

g = for x ^ —L and x > L — a. (12) 

Then 

/(•«•) = / g(y) dy 

= I h(x - y)g(y) dy 

.' -co 

holds true for all x. Here 

m _h, -.4.4(1 

[0, otherwise. 



(13) 
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Taking the Fourier transform of (13) yields 

(7(A) = *f (loVa) ■ * /9 v F(X) (14) 

v 7 sin (Xa/2) 

which shows that g[x + (a/2)] can be obtained from the extended 
blurred photograph by processing with a filter having transfer function 

Foe = tt . * = (15) 

sin (Xa/2) 

as has been reported previously. 1 

The filter (15) has poles at the points X = 2nir/a, \n\ = 1, 2, 
and hence cannot be realized in practice. Some ad hoc scheme for 
assigning a finite value at these pole positions must be made. Just 
what these modified filters do to picture quality is not easy to analyze. 
The filter (15), could it be instrumented, would yield g, that is, a 
picture with infinite white skirts. The filter (11), on the other hand, 
has no poles and hence can be realized.* It restores g correctly in the 
interval x ^ x ^ x a + pa where this quantity is different from zero. 
It gives uninterpretable values for x > x + pa and the value zero 
for x < x . It would appear that the infinities in (15) with their at- 
tendant difficulties are due to insisting that the processed picture yield 
the value zero over an infinite region where from a priori knowledge 
one would accept no other value anyhow. 

It is worth noting that if (12) is violated, then (13) does not hold 
for all x and one cannot write (14). These edge effects have been over- 
looked in past treatments of the problem based on (14). 1 

III. ESTIMATION OF MOTION PARAMETERS 

The restoration technique of the preceding section presupposed 
knowledge of the direction and amount of the image displacement 
during exposure. We now consider how these quantities might be 
determined from the blurred photograph itself. 

We suppose the blurred photograph density to be given by 

/(*, y) = / g(x - ut,y -vt)dt, | x | ^ L x , | y I £ L % , (16) 

where g(x, y) is the image that would result if there were no motion. 
Again to avoid edge effects we suppose g(x, y) defined everywhere 

* Because of the growing factor X, both (15) and (11) must ultimately be cut off 
at some point beyond the largest spatial frequency of interest in the photographs. 
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and different from zero only in the rectangle — L, ^ x ^ L, — uT, 
— L 2 2S y ^ La — yT, so that defining / = for | x \ > L, , | y \ > L 2 
we can write 

K x > V) = I d( x — ut, y — vt) dt, — co ^ x, y ^ oo . (17) 

•M) 

Into (17) now introduce the Fourier representation 
g(x, y) = JT </{ JT rfi, flfft, „y' ,t * +wl . 

There results 

/(*, y) = /" T <*/ f # f d v eft. ,y«*- »*«—»' 



(18) 

= f dk f dne'^Wt, v )e- il( ^ b)/2] 8i " ( ^ + ,^ ) /2 

on performing the t integration. Here 

a = uT, b = vT. 

Since (18) holds for all x and y, we see that the Fourier transform of / 
is given by 

P(t -> - rtt „v>- , ' l(£a+,,6)/21 sin (ga + i?&)/2 ,. Q s 

Fit, V) - G& v)e (JSa + ^ )/2 (19) 

As seen from (19) the transform of the blurred photograph is zero 
on the family of parallel lines 

£a + v b = 2nw n = ±1, ±2, • • • . 

These lines of zero density in F should provide a reasonable means 
of estimating the parameters a and b. Due to noise, the curves of zeros 
of F will not appear as straight lines. The job of fitting straight lines 
to these curves of zeros should be greatly simplified however by the 
knowledge that the lines are parallel and uniformly separated. Once 
the fitted lines are drawn, value of a and b are readily found. 

IV. MORE GENERAL MOTION 

In the present model, the blurred photograph that results from the 
general nondistance-distorting motion of a small object is 
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1(x, y) = / dt g[(x - u) cos tp — (y — v) sin tp, 

Jo 

■(x - u) sin <p + (y — v) cos tp]. (20) 

Here g(x, y) is the illuminance that would result if the object were 
at rest with respect to the film during the exposure, u and v are functions 
of t giving, respectively, the x and y coordinates of the origin of a 
coordinate system fixed with respect to the body, and tp = <p(t) is 
the angle that this second coordinate frame makes with respect to the 
x-y frame. In the case of most immediate interest 

u = x + III 

v = y + vt (21) 

tp — cot. 

One finds without difficulty that the Fourier transform of / and g 
are related by 

C r 
Ffa v ) = / dt «~"" ,+M, G r R cos tp - v sin tp, g sin tp + 77 cos tp]. (22) 

This equation appears somewhat simpler in polar coordinates. We write 
£ = p cos 6 7i = p sin 6 
u = V cos a v = V sin a 
and set 

F(S,v) - F(p,0) G&rf) = <?(p, d). 
Then (22) becomes 

f\ P , e) = [ dte- ipVc " a{e - a) ti( P , e + tp). 

Jo 



(23) 



Here V, a and tp are functions of t. 

Under these general conditions, I have been unable to find a practical 
method for obtaining the undistorted scene g from /, either in the space 
domain, or from the transform statements (22) and (23). Even in the 
case of combined uniform translation and uniform rotation given by 
(21) no method is as yet evident. 

The case of pure uniform rotation, u = v = can, however, be 
treated and complements the case of pure translation (to = 0) already 
discussed in Sections II and III. Working directly in the space domain, 
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(20) becomes 
/(•*•'. U) = I dt g[(.x — Xq) cos col — (y — y ) sin cot, 

•'o 

■(x — .r ) sin wt + (y — y„) cosw/]. 
Introduce polar coordinates located at the center of rotation 

x — X = p cos 6 
V — lh = P sin 
j(p, 0) = 1(x, y), 0(p, e) = g( P cos 6, psin fl). (24) 

We now have 

]( P , e) = I dt g( P . e + cot) 



= - / <w ^( Pl 0') 



which is basically of the form (3) already treated. The basic restoration 
equation is 

0(p. e) = -co j % f( P , e) + fo, e + uT), (25) 

where p is to be regarded as a parameter, g and / are periodic in 6 
with period 2ir and the equation holds for all values of 9. 

If g(p, 8) is known a priori as a function of 6 along an arc of angular 
extent coT radians, (25) can be used successively to determine for 
all 6. It is not hard to show that if § is not known a priori on a 6 set 
of angular measure coT, unique restoration is impossible. Indeed, there 
exists a scene with values assigned arbitrarily (except for an additive 
constant) in a wedge of angle coT which, when rotated, will give rise 
to any preassigned blurred photograph. 

In the case of a blurred photograph of a rotating unknown object, 
for example, if the center of rotation is within the body, unique restora- 
tion is impossible in the neighborhood of this center. If restoration 
is to be made, one must use some form of a priori knowledge to specify 
$ or an estimate of $ in some angular interval of amount toT. 

Restoration by means of the difference equation (25) presupposes 
knowledge of co and [from (24)] the center of rotation .r , y . We have 
not found a simple way of estimating these parameters. Unlike the 
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case of pure translation, the Fourier transform of the blurred picture, 

F( P ,e) ■.,-"—-»♦—■•« [ T dtG( P ,e + ut), 

J a 

does not seem to offer special clues. If the object has some straight 
line edges, their initial and final positions may show clearly enough 
in the blurred photograph to allow estimates of x , y and wT to be 
made. For example, if U and l[ are the lines along the initial and final 
positions of some edge of the body, the angle between Z, and l{ is clearly 
o)T. Let l 2 and V 2 be lines along the initial and final position of some 
other straight line feature of the object and let P be the intersection 
of k with l 2 and P' be the intersection of l[ with V 2 . The center of rota- 
tion must lie on the perpendicular bisector of the segment PP', and 
its position is chosen so that /.POP' = coT. It is likely that, in practice, 
restoration with several different trial values of the parameters will 
have to be made and the best result selected. 
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